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DIAGNOSTIC  READING  PROGRAM  SURVEY 

OVERVIEW  OF  THE  DIAGNOSTIC  READING  PROGRAM 

The  Diagnostic  Reading  Program  is  intended  to  help  elementary  classroom  teachers  meet  the  needs 
of  individual  students  more  effectively.  The  program  provides  teachers  with  a systematic  and 
strategic  approach  for  observing  the  reading  behaviors  of  their  students  and  for  identifying  student's 
strengths  and  weaknesses  in  reading.  It  also  provides  a means  for  teachers  to  select  materials  that 
are  at  the  student’s  reading  level  and  to  plan  appropriate  follow-up  activities. 

The  program  consists  of  an  evaluation  and  instructional  component.  Specially  designed  reading 
passages  are  the  basic  evaluative  instrument.  The  Diagnostic  Reading  Program  offers  six  evaluation 
strategies  to  help  teachers  focus  on  the  specific  behaviors  of  their  students.  These  include  the 
Reading  Process  Checklist,  Oral  Reading  Miscues,  Retelling,  Comprehension  Questions,  Cloze,  and 
Sentence  Verification. 

The  second  component  consists  of  instructional  strategies  intended  to  address  the  student’s  needs 
identified  during  evaluation.  These  instructional  strategies  are  designed  so  that  students  must 
process  both  print  information  and  background  knowledge  in  a variety  of  ways.  Students  are 
involved  in  real  reading  activities,  that  is,  they  read  stories  or  passages  rather  than  isolated  words. 

Teachers  from  across  the  province  were  trained  as  inservice  leaders  in  the  fall  of  1986  to  serve  as 
resource  persons  to  assist  in  implementing  the  Diagnostic  Reading  Program  at  the  school  and 
jurisdiction  levels.  Throughout  the  1987-88  and  the  1988-89  school  years  most  Alberta  jurisdictions 
included  plans  for  implementing  the  Diagnostic  Reading  Program. 


PURPOSE  OF  THE  STUDY 

A two-phase  study  was  developed  in  April,  1988  to  address  the  level  of  implementation  of  the 
Diagnostic  Reading  Program  and  to  determine  the  effect  that  use  of  the  Diagnostic  Reading  Program 
materials  has  on  levels  of  student  achievement.  Information  regarding  the  effectiveness  of  the 
Diagnostic  Reading  Program  is  essential  in  order  to  make  appropriate  decisions  regarding  future 
developments  in  the  Diagnostic  Evaluation  Program. 

Phase  I,  conducted  in  June  1988,  included  distribution  of  a questionnaire  to  collect  information 
about  implementation  of  the  Diagnostic  Reading  Program  and  the  perceived  effectiveness  of  the 
program  on  student  achievement.  Phase  II  of  the  study  was  carried  out  in  the  1988-89  school  year 
to  determine  the  effect  of  use  of  Diagnostic  Reading  Program  on  levels  of  student  achievement. 
Students  in  classrooms  where  the  teachers  used  the  Diagnostic  Reading  Program  and  in  classrooms 
where  the  teachers  did  not  use  the  Diagnostic  Reading  Program  were  involved. 
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DIAGNOSTIC  READING  PROGRAM  SURVEY 
PHASE  I 


PURPOSE 

Phase  I was  designed  to  collect  information  regarding  the  implementation  of  the  Diagnostic  Reading 
Program  in  elementary  classrooms  throughout  Alberta. 


PROCEDURE 

Questionnaires  were  distributed  and  principals  and  teachers  were  asked  to  respond  to  the 
questionnaires.  Multiple-choice  as  well  as  open-ended  questions  were  included  in  the 
questionnaires. 


HIGHLIGHTS  OF  FINDINGS 

PRINCIPAL  RESPONSES 

Based  on  333  questionnaires  returned: 

(a)  Forty  seven  percent  of  the  principals  felt  that  their  personal  knowledge  of  the  reading  process 
was  enhanced  because  of  the  implementation  of  the  Diagnostic  Reading  Program  in  their 
schools. 

(b)  Thirty  six  percent  of  the  principals  felt  that  the  Diagnostic  Reading  Program  contributed  to  the 
professional  development  of  their  staff. 

(c)  Eleven  percent  of  the  principals  felt  that  students  made  real  gains  in  reading  as  a result  of 
using  the  Diagnostic  Reading  Program. 

TEACHER  RESPONSES 

Based  on  3 139  questionnaires  returned: 

(a)  Fifty  one  percent  of  the  teachers  used  the  Diagnostic  Reading  Program  in  their  classrooms. 

Of  these  teachers: 

• 1 296  used  it  as  a tool  to  diagnose  strengths  and  weaknesses 

• 1219  used  it  as  a general  resource  used  in  conjunction  with  other  resources 
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• 1 086  used  it  as  a tool  for  remediation  of  students  weaknesses 

• 1 000  used  it  as  a tool  to  review  or  check  students’  reading 
level  and  progress  throughout  the  year,  and 

• 416  used  it  as  a resource  for  enrichment  of  students 

(b)  The  program  was  not  used  by  some  teachers  for  the  following  reasons: 

• 964  found  it  to  be  time  consuming,  complex,  and  cumbersome  to  use 

• 937  preferred  other  resources 

• 652  received  insufficient  inservices 

• 225  had  not  heard  about  the  Diagnostic  Reading  Program  prior  to  the  questionnaire 

(c)  Written  comments  identifying  strengths  of  the  program  included  the  following: 

• effective  program 

• will  be  used  more  in  the  future 

• educates  teachers  about  the  reading  process 

• inservice  was  effective 

INTERPRETATION  OF  RESULTS  OF  TEACHER  SURVEY 

The  results  of  the  survey  indicated  that  the  Diagnostic  Reading  Program,  when  it  is  being  used,  is 
meeting  the  objectives  of  implementation  by: 

(a)  enhancing  formative  evaluation  in  classrooms,  i.e.,  the  Diagnostic  Reading  Program  is  being 
used  as  intended,  primarily  for  purposes  of  identifying  students’  strengths  and  weaknesses  in 
reading. 

(b)  helping  teachers  to  meet  the  individual  needs  of  students  through  appropriate  instruction. 

(c)  contributing  to  professional  growth  of  teachers  and  administrators. 
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IMPLICATION  OF  SURVEY  RESULTS 

Further  inservicing  of  the  Diagnostic  Reading  Program  needs  to  be  considered.  Further  inservicing 
will  achieve  the  following: 

(a)  address  the  concerns  expressed  by  teachers  that  prior  inservicing  was  insufficient. 

(b)  increase  use  of  the  Diagnostic  Reading  Program  by: 

• providing  an  opportunity  for  those  teachers  and  administrators  who  know  about  the 
Diagnostic  Reading  Program  to  become  more  familiar  with  the  program. 

• advertising  the  Diagnostic  Reading  Program  to  a wider  audience  of  teachers  and 
administrators. 

• communicating  that  the  Diagnostic  Reading  Program  has  been  developed  by  Alberta 
teachers  and  normed  on  Alberta  students  for  Alberta  students. 

(c)  provide  an  opportunity  to  integrate  the  software  component,  when  completed,  with  the 
current  program. 

(d)  provide  an  opportunity  to  articulate  the  reading  and  mathematics  elementary  diagnostic 
evaluation  programs. 


Diagnostic  Evaluation  Program 
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DIAGNOSTIC  READING  PROGRAM  SURVEY 


PHASE  II 


PURPOSE 


The  study  was  designed  to  establish  the  effects  of  the  Diagnostic  Reading  Program  on  levels  of 
student  achievement. 

PROCEDURES 

Several  grade  6 classrooms  in  which  teachers  used  the  Diagnostic  Reading  Program  were  identified 
and  matching  classrooms  in  which  the  teachers  did  not  use  the  Diagnostic  Reading  Program  were 
found.  Grade  six  students  were  selected  since  they  could  have  been  on  the  program  for  three  years. 
Students  in  these  classrooms  were  administered  the  reading  portion  of  the  1988  Grade  6 English 
Language  Arts  Achievement  Test.  The  test  was  administered  twice;  once  in  January  1989,  and  again 
in  June  1989.  The  test  consisted  of  50  multiple-choice  questions  based  on  a variety  of  reading 
selections. 

Usable  pairs  of  scores  were  obtained  for  162  students  in  seven  classrooms  using  the  Diagnostic 
Reading  Program  and  for  162  students  in  six  classrooms  where  teachers  did  not  use  the  Diagnostic 
Reading  Program. 


RESULTS 


The  scores  were  analysed  using  both  a repeated  measures  analysis  of  variance  and  an  analysis  of 
covariance  using  the  January  scores  as  a covariate.  The  January  test  scores  were  very  nearly  the 
same  for  the  two  groups.  The  June  scores  were  different  by  more  than  three  raw  score  points. 

The  results  from  the  analyses  were  consistent,  showing  a statistically  significant  effect  for 
participation  in  the  Diagnostic  Reading  Program.  As  Table  1 shows,  the  students  who  were  in 
classses  in  which  the  teacher  used  the  Diagnostic  Reading  Program  achieved  higher  scores  on  the 
reading  portion  of  the  language  arts  achievement  test  than  students  in  classes  in  which  the  teacher 
did  not  use  the  Diagnostic  Reading  Program.  (See  also  Figure  1 on  page  6.) 


Table  1 


Average  Scores  on  Achievement  Test 


Time  of  Writing  Total  Questions  Teacher  Used  DRP  Teacher  Did  Not  Use  DRP 


January  1989 
June  1989 


50 

50 


29.83 

34.75 


29.07 

31.52 


Multiple  Choice  Items 
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Figure  1 


Diagnostic  Reading  Program  Survey 

Achievement  Test  Scores 


E§r’  1 Not  in  Diagnostic  Reading  Program  Class 


V///a  In  Diagnostic  Reading  Program  class 
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DISCUSSION/CONCLUSIONS 

According  to  the  results  of  the  Phase  II  study,  the  Diagnostic  Reading  Program  is  effective  in 
increasing  student  achievement.  The  perceptions  of  teachers  and  administrators  who  completed  the 
questionnaires  in  Phase  I of  the  study  were  confirmed.  Students  made  gains  in  reading  as  a result  of 
using  the  Diagnostic  Reading  Program.  By  providing  teachers  with  a means  for  continuous 
assessment,  the  result  is  evidenced  in  enhanced  student  outcomes. 

The  Diagnostic  Reading  Program  enables  dynamic  assessment  by  strategically  linking  evaluation 
and  instruction.  The  program  provides  teachers  with  a systematic  procedure  for  teaching 
diagnostically,  discovering  their  students’  strengths  and  weaknesses,  and  taking  these  into  account 
when  planning  for  and  delivering  instruction.  When  teachers  use  the  results  of  diagnostic 
asssessment  to  plan  for  more  effective  instruction,  students’  achievement  increases.  Not  only  is 
students'  learning  enhanced  but,  also,  indications  are  that  as  they  achieve  success  their  attitudes  and 
self-concepts  become  more  positive. 

Enhancement  of  their  self-concept  encourages  students  to  become  conscious  of  their  strengths  and 
weaknesses  and,  through  monitoring  of  their  own  learning,  move  toward  control.  This  type  of 
growth  is  a gradual  process.  This  may  account  for  the  fact  that  a greater  increase  in  achievement  for 
the  Diagnostic  Reading  Program  students  was  in  evidence  in  June. 

As  well,  as  teachers  become  more  familiar  with  the  Diagnostic  Reading  Program,  they  may  be  using 
the  program  more  often  as  the  school  year  progresses,  thereby  meeting  the  needs  of  more  students  in 
their  classes.  The  significant  increase  in  achievement  noted  in  June  may  also  be  due  to  "spill-over" 
effects.  As  teachers  internalize  the  program  content  by  using  the  Diagnostic  Reading  Program,  their 
observation  of  students'  behavior  becomes  more  systematic  resulting  in  more  strategic  planning  for 
instruction  to  meet  students’  needs. 


